• 专利附录
  • 专利说明
  • 权利要求
  • 类似技术
  • 同族专利
  • 引用文献
  • 法律状态
  • 优先权
    • 专利摘要:
    user interface for a remote control device. an embodiment of the present invention exposes a technique for controlling the operations of a consumer electronic device (CE). a system includes a display device, CE device and a remote controller with a touch-sensitive surface. device ce is configured to produce a context-specific user interface for display by the display device. the particular user interface varies based on the operational context of the ce device. the remote controller sends signals that are detected by device ce and control operations are performed by device ce. more specifically, the remote controller is used as a handheld pointing device to select operations through interactions with the context-specific user interface. a user can apply gestures to the touch-sensitive surface that are interpreted based on the context-specific user interface to control the ce device.
    公开号:BR112013013945B1
    申请号:R112013013945-5
    申请日:2011-12-06
    公开日:2021-08-17
    发明作者:Neil D. Hunt
    申请人:Netflix, Inc.；
    IPC主号:
    专利说明:

    CROSS REFERENCE TO RELATED ORDERS
    This application claims benefit of United States Patent Application 12/961,387, filed December 6, 2010, which is incorporated herein by reference. BACKGROUND OF THE INVENTION Field of Invention
    This disclosure generally relates to a displayed user interface for consumer electronic devices, and more specifically to activating the user interface using a remote controller including a touch sensitive surface. Description of Related Technique
    There are numerous websites that contain media content, for example, video, images, audio, video conferencing and more. Media content ranges from major news, sports, movie and entertainment sites, to home video clips, personal photo collections, and the full range of sites in between. In general, with such websites, a pointing device such as a mouse is used to interact with the media content, and the content is viewed on a display attached to a personal computer.
    Recently, consumer electronics devices have started to be configured as connected media devices, for example, connected Blu-Ray players, media adapters, connected televisions, digital video recorders and cable distribution boxes. In contrast to personal computing devices that use a pointing device such as a mouse to interact with content, when interacting with content via these consumer electronic devices, a handheld remote control device is typically used that can navigate a menu displayed in a limited number of directions such as left, right, up and down. Consequently, media content designed for viewing on a personal computer may not be easily viewed through a consumer electronic device because the media content cannot be browsed easily or at all with a handheld remote control device. Furthermore, the typical handheld remote control device includes numerous keys to control the different operations that can be performed by the consumer electronic device. In order to press a particular key, a user may need to read an identifier on the key or the keys may require backlighting which consumes more power. Overall, the typical handheld remote is less intuitive and more labor intensive than a pointing device such as a typical mouse.
    As the above illustrates, what is needed in the art is a device that can be used to more intuitively control how content is viewed when interacting with content through a consumer electronics device. Additionally, it is desirable to produce a low-cost indicating device that can control a consumer electronic device. SUMMARY OF THE INVENTION
    One embodiment of the present invention exposes a technique for controlling the operations of a consumer electronic device (CE) via an intuitive context-specific user interface and moving cursor. A system includes a display device, CE device and a remote controller with a touch-sensitive surface. The CE device is configured to generate a context-specific user interface for display by the display device. The particular user interface varies based on the operational context of the CE device. The remote controller sends signals that are detected by the CE device and controls operations performed by the CE device. More specifically, the remote controller is used as a handheld pointing device to position the moving cursor and select operations through context-specific user interface interactions. A user can apply gestures to the touch-sensitive surface that are interpreted based on the context-specific user interface to control the CE device.
    An embodiment of the invention provides a computer-implemented method for controlling a consumer electronic device. The method includes receiving a signal from a remote controller that is configured to control the consumer electronic device, where the signal is generated in response to a user gesture that is applied to a touch-sensitive surface of the remote controller. An operational context is determined based on a function being performed by the consumer electronics device.
    In response to the signal received from the remote controller, a context-specific user interface based on the operational context is generated for display on a display device associated with the consumer electronics device. Also in response to the signal received from the remote controller, a cursor and having a position that is controlled by the signal received from the remote controller is generated for display and overlaid on the context-specific user interface.
    Compared to conventional multi-key remote controllers, a remote controller including a touch-sensitive surface provides an inexpensive solution for controlling a CE device through interaction with a context-specific user interface displayed on an existing display on a CE device or connected to him. The context-specific user interface simplifies user interaction to control the CE device as the user interface only includes controls that are pertinent to current operations for the CE device. BRIEF DESCRIPTION OF THE DRAWINGS
    In order that the above-reported features of the present invention may be understood in more detail, a more particular description of the invention, set out briefly above, may be made by reference to embodiments, some of which are illustrated in the accompanying drawings. It is to be noted, however, that the accompanying drawings illustrate only typical embodiments of this invention and therefore are not to be considered as limiting its scope, as the invention may admit other equally effective embodiments.
    Figure 1 illustrates a system configured to implement one or more aspects of the present invention;
    Figure 2 is a block diagram illustrating the consumer electronic device and display device of Figure 1, in accordance with an embodiment of the present invention;
    Figure 3 presents a flowchart of method steps for controlling the consumer electronic device, in accordance with an embodiment of the present invention;
    Figures 4A, 4B, 4C, 4D and 4E illustrate context-specific user interfaces, in accordance with an embodiment of the present invention; and
    Figure 5 illustrates the remote controller of Figure 1, in accordance with an embodiment of the present invention. DETAILED DESCRIPTION
    In the following description, a number of specific details are set out to provide a more complete understanding of the present invention. However, it will be apparent to those skilled in the art that the present invention can be practiced without one or more of these specific details. In other cases, well-known features have not been described in order to avoid obscuring the present invention.
    Figure 1 illustrates a system 100 that is configured to implement one or more aspects of the present invention. System 100 includes a display device 120, consumer electronic device (CE) 115, and a remote controller 110 with a touch-sensitive surface 105. The remote controller 110 can communicate with the CE device 115 via optical technology. infrared or a RF wireless link based on Bluetooth, WiFi, Z-wave, or other low-power digital wireless connection. The connection can be unidirectional (from remote controller 110 to CE 115 device) or bidirectional. The touch-sensitive surface 105 of the remote controller 110 may be a touch-sensitive input device using capacitive technology or the like to detect gestures, e.g., light tap, hard tap and the like, applied by a user. Remote controller 110 can be packaged in a suitable housing for a handheld device, for example, a housing 15 cm long, 5-10 cm wide and 1 cm thick.
    Remote controller 110 is configured to control CE device 115, e.g., television, DVD player, signal converter apparatus, and other media device that includes an integrated display or that is coupled to display device 120. The display device 110 can be a conventional CRT or LCD-based monitor, projection screen, a combination of a projector and screen, or the like. In one embodiment, the CE device 115 may comprise a signal converter apparatus configured to receive streaming audio-visual media, to convert the media into one or more output signals in a specified audio-visual format, and to provide the one or more audio signals. output to display device 120. In another embodiment, client computer 110 may comprise a digital disc media player, such as a Blu-ray player, configured to receive streaming audiovisual media, to convert the media to one or more output signals in a specified audiovisual format, and to provide the one or more output signals to the display device 120. In another embodiment, the CE device 115 may comprise a personal computer, laptop, notebook or computer hand. Modalities also encompass a computer program product that can be loaded onto a computer to perform the functions that are described in this document. Thus, an embodiment may comprise a computer readable storage media storing one or more sequences of instructions which, when executed by one or more digital processors, cause the processors to perform steps as shown and described.
    The consumer electronic device 115 is configured to generate a context-specific user interface for display on the display device 120. The particular user interface varies based on the operational context of the CE device 120, where the operational context is the function being performed by the CE 120 device at the particular moment in time. For example, the operational context of the CE 120 device varies when a DVD is inserted into the CE 120 device compared to when the DVD content is playing. The operational context of the CE device 120 is different when the CE device 120 is configured to provide a video conferencing function compared to when the CE device 120 is configured such as a game box. Additionally, the context-specific user interface may include selection controls, for example a drop-down menu or radio keys, to select a particular station or playlist based on the operational context of the CE device 120 when the CE device 120 is configured to provide an audio media playback function. Other context-specific user interfaces may provide an on-screen keyboard to allow a user to input specific words, channels, call letters and more, based on other operational contexts of the CE 120 device.
    The remote controller 110 sends signals that are detected by the CE 115 device and controls operations performed by the CE 115 device. More specifically, the remote controller 110 is used as a hand-held indicating device to select operations through interactions with the specific user interface of context. A user can apply gestures to the touch-sensitive surface 105 that are interpreted by the CE 115 device based on the context-specific user interface to control the CE 115 device. Importantly, the user interface is displayed on the display device 120 and not on the remote controller 110. Therefore, displaying status information is not necessary on the remote controller 115. In one embodiment, the remote controller 110 only includes the touch-sensitive surface 105 and does not include keys or other mechanism for receiving user-supplied input. .
    Since context-specific user interface and associated feedback are provided on display device 120, remote controller 110 can consume very little power, and can be powered by two or three AA or AAA size batteries. In one embodiment, remote controller 110 includes a status display that is configured to highlight different control sets on the touch-sensitive surface 105 with selective backlighting.
    The context-specific user interface that is displayed by the display device 120 simplifies user interaction as compared to controlling the CE 115 device via a conventional multi-key remote control device. In particular, only controls that are pertinent to operations that can be performed by the user are included in the context-specific user interface. For example, when the CE device 115 is configured to display web pages on the display device 120 and to perform web page operations, a context-specific user interface for browsing web pages can be displayed. Remote controller 110 controls the position of a cursor which is overlaid on the context-specific user interface and which is used to select various operations or actions to be performed by the CE device 115 via the context-specific user interface.
    When the CE 115 device is configured to play digital audio and video content a context-specific user interface that includes transport controls, for example, Play, Stop, Pause, Fast Forward, Rewind, Next, Previous and more, can be displayed. A context-specific user interface can also include mode-sensitive controls, for example, play, eject, power, and more configuration controls. Since the context-specific user interface is displayed on the display device 120, no additional lighting is needed in the environment or remote controller 110, such as backlighting. Therefore, the remote controller 110 can be operated without additional lighting and does not require any physical keys to provide input commands to the CE 115 device.
    When the user activates the remote controller 110 a signal is transmitted to the CE device 115. The signal can be transmitted in response to a motion sensor when the user picks up the remote controller 110 and when the user touches or taps the touch-sensitive surface 105. The CE 115 device overlays a moving cursor and context-specific user interface including graphical representations of controls appropriate for the mode. The user interface may appear on the screen as fading, sliding off an edge, or otherwise appearing possibly superimposed on the video or images or other content on the display device 120. Using a finger, the user taps or taps the sensitive surface. tap 105 with directional gestures that make the cursor move on the display device 120. Clickable controls included in the context-specific user interface can be highlighted as the cursor hovers over the controls. In contrast, many conventional remote control devices are limited to cursor movement only to left, right, up and down directions. Therefore, user interaction with an associated menu is limited to these cursor movements. Also, a conventional remote control device typically has several keys that control cursor movement and other operations. Only a subset of the keys can be pertinent to a particular operating mode of the CE 115 device. Finding the correct keys to activate on a conventional remote control device can be challenging for a user, particularly when the lighting level is low and identifiers on the keys cannot be seen easily.
    According to an embodiment, the techniques described in this document are implemented by means of one or more special-purpose computing devices. Special purpose computing devices can be physically connected to perform the techniques, or they can include digital electronic devices such as one or more application-specific integrated circuits (ASICs) or field-programmable gate arrays (FPGAs) that are programmed in a way. persistent to execute the techniques, or may include one or more general purpose hardware processors programmed to execute the techniques in accordance with program instructions in firmware, memory, other storage, or a combination thereof. Such special-purpose computing devices can also combine custom hardwired logic, ASICs, or FPGAs with custom programming to perform the techniques. Special purpose computing devices may be desktop computer systems, handheld computer systems, handheld devices, network devices, or any other device that incorporates hard-wired logic and/or software to implement the techniques. System Overview
    Figure 2 is a block diagram illustrating the CE device 115 and the display device 120 of Figure 1, in accordance with an embodiment of the present invention. Device CE 115 includes a central processing unit (CPU) 202 and a system memory 204 communicating via an interconnection path that may include a bridge 205. The CPU 202 may be, for example, a general purpose microprocessor and system memory 204 may be random access memory (RAM) or other dynamic storage device for storing information and instructions to be executed by the CPU 202. System memory 204 may also be used to store temporary variables or other information intermediate during execution of instructions to be executed by the CPU 202. Such instructions, when stored on storage media accessible to the CPU 202, render the CE 115 device in a special-purpose machine that is customized to perform the operations specified in the instructions.
    A device driver 203 may be stored in system memory 204 and configured to translate signals received from remote controller 110 to commands to device CE 115. A system disk 214, such as a magnetic disk or optical disk, is provided and coupled to a bridge 205 to store information and instructions. The CE device 115 can be coupled via a bus to a display device 120 and the bridge 205 can receive user input from one or more user input devices (e.g. keyboard, physical keys, mouse or stationary mouse) via a direct input interface 208. Bridge 205 sends user input to CPU 102 and provides display pixels for display device 120.
    The CE 115 device can implement the techniques described in this document using custom hard wired logic, one or more ASICs or FPGAs, firmware and/or program logic that, in combination with the computer system, induces or program the CE 115 device to be a special use machine. According to one embodiment, the techniques in this document are performed by the CE device 115 in response to the CPU 202 executing one or more sequences of one or more instructions contained in system memory 204. Such instructions can be read in system memory 204 of a other storage media, such as system disk 214. Executing the sequences of instructions contained in system memory 204 causes the CPU 202 to perform the process steps described in this document. In alternative embodiments, hard-wired circuitry can be used in place or in combination with software instructions.
    The term “computer readable storage media” as used in this document refers to any media that stores data and/or instructions that induce a machine to operate in a specific mode. Such storage media may comprise non-volatile media and/or volatile media. Non-volatile media include, for example, optical or magnetic disks, such as system disk 214. Volatile media, include dynamic memory, such as system memory 204. Common forms of storage media include, for example, a floppy disk, a floppy disk, hard disk, solid state drive, magnetic tape, or any other magnetic data storage media, a CD-ROM, any other optical data storage media, any physical media with hole patterns, a RAM, a PROM and EPROM, a FLASH-EPROM, NVRAM, and any other memory chip or cartridge.
    Storage media is distinct but can be used in combination with broadcast media. Broadcast media participate in transferring information between storage media. For example, transmission media include coaxial cables, copper wire and fiber optics, including the wires that couple components to the bridge 205 and a switch 216. Transmission media can also take the form of acoustic or light waves, such as those generated during radio wave and infrared data communications.
    Switch 216 provides connections between bridge 205 and other components such as a network link 118 and various embedding cards such as embedding card 220. Other components (not shown explicitly), including USB or other port connections, drives CD, DVD drives, movie recording devices, and more can also be connected to bridge 205. A remote controller interface 215 that is coupled to switch 216 can include an infrared detector that can receive the data carried in a infrared signal generated by remote controller 110 and can provide the signal to CPU 202 and/or device driver 203.
    Switch 216 also provides a bidirectional data communication coupling to a network link 218 that is connected to a local network. For example, network link 218 may include a local area network (LAN) card to provide a data communication connection to a compatible LAN. Wireless links can also be implemented. In any such implementation, network link 218 sends and receives electrical, electromagnetic, or optical signals that carry digital data streams representing various types of information.
    Network link 218 typically enables data communication through one or more networks to other data devices. For example, network link 218 may provide a connection over a local network to a host computer or to data equipment operated by an Internet Service Provider (ISP). An ISP in turn provides data communication services through the world-wide packet data communication network now commonly referred to as the “Internet”. Both a local area network and the Internet use electrical, electromagnetic or optical signals that carry digital data streams. The signals across the various networks and the signals on the network link 218 and across the switch 216 which carry the digital data to and from the CE device 115 are exemplary forms of transmission media.
    Device CE 115 can send messages and receive data, including digital audio and video data and program code, via the network(s) and network link 218. The received code can be executed by the CPU 202 as it is received and/or stored on system disk 214, or other non-volatile storage, for later execution. The received digital audio and video data can be displayed by the display device 120 under the control of the CPU 202.
    It will be appreciated that the system shown in this document is illustrative and that variations and modifications are possible. The connection topology, including the number and arrangement of bridges, the number of CPUs 202 and the number of display devices 120, can be modified as desired. For example, in some embodiments, system memory 204 is connected to CPU 202 directly rather than through a bridge, and other devices communicate with system memory 204 via the CPU 202. The particular components shown in this document are optional ; for example, any number of embedding cards or peripheral devices can be supported. In some embodiments, switch 216 is eliminated, and network link 218, remote controller interface 215, and embedding card 120 are directly connected to bridge 205.
    Figure 3 shows a flowchart of method steps for controlling the CE 115 device, in accordance with an embodiment of the present invention. Although the method steps are described in combination with the systems for Figures 1 and 2, those skilled in the art will understand that any system configured to perform the method steps, in any order, is within the scope of the invention.
    The method begins at step 300, where the CE device 115 receives a signal from the remote controller 110 that is configured to control the CE device 115. The signal is generated in response to a user gesture that is applied to the touch-sensitive surface 105 of the remote controller 110. At step 305 the CE device 115 determines an operational context based on a function being performed by the CE device 115. The operational context may depend on the content displayed on the display device 120. For example, when a user views a page network with a video or the CE 115 device is playing a video, the operational context is video playback. When a DVD is inserted into the CE 115 device the operational context is DVD control.
    In step 310, in response to the signal received from the remote controller 110, the CE device 115 generates a context-specific user interface based on the operational context for the display device 120. Also in response to the signal received from the remote controller 110, in step 315 the CE 115 device generates a cursor at a position that is controlled by the signal from the remote controller. The user interface is displayed by the display device 120 and the cursor is superimposed on the user interface in position.
    At step 320 the CE device 115 determines whether the signal indicates that a gesture has been applied to the touch sensitive surface 105 of the remote controller 110 by a user, and if not, at step 325 the CE device 115 determines whether a timeout has expired. A timeout counter is used to determine when displaying the UI and/or the cursor should be stopped due to inactivity. A small time interval, for example 500 ms, 2 seconds, between gestures or movement of the remote controller 115 may be the cause for the timeout counter to expire. If, in step 325, the timeout has not expired, then the CE 115 device returns to step 320. Otherwise, in step 335 with the timeout having expired the context-specific user interface and cursor are removed from the device 120. The context-specific user interface and cursor may fade out, slide off the screen, or otherwise disappear.
    If at step 320 the CE device 115 determines that the signal indicates that a gesture has been applied to the touch sensitive surface 105 of the remote controller 110 by a user, then at step 330 the CE device 115 performs the operation specified by the gesture. Examples of gestures include a single tap, double tap, or multiple tap, and a hard tap or directional stroke on the touch-sensitive surface 105. The cursor position on display device 120 is updated based on the directional gestures.
    Figure 4A illustrates a context-specific user interface 405 that is displayed by display device 120, in accordance with an embodiment of the present invention. When the operational context of the CE 115 device is DVD playback, the context-specific user interface 405 can include graphics for transport controls, for example, Play, Stop, Pause, Fast Forward, Rewind, Next, Previous, and keys of DVD Menu. In one modality, a gesture such as a double-tap anywhere on the 455 context-specific user interface can activate the playback function and a triple-tap can activate the fast-forward function. The graphical elements for the Stop, Play, and Pause transport controls 410 are shown in figure 4A. Cursor 420 is superimposed on context-specific user interface 405 in a position that is controlled by remote controller 110.
    Figure 4B illustrates a context-specific user interface 405 that is displayed by display device 120, in accordance with an embodiment of the present invention. Clickable controls can be highlighted as the cursor passes over the graphics for the control, as shown in Figure 4B by a selection indication 422 when the cursor 420 is positioned over the graphics for the Play control. Importantly, since the graphical elements for controls are represented on the display device 120, operation in a dark environment does not require recalling the layout of specific keys on the remote controller 115. The graphical elements for controls are visible on the display device. display 120, and relative motion gestures are applied to the touch-sensitive surface 105 to control the CE device 115.
    Figure 4C illustrates a context-specific user interface 435 that is displayed by display device 120, in accordance with an embodiment of the present invention. When the operational context of the CE 115 device is an inactive DVD after playback is complete or when a DVD is inserted, the context-specific user interface can include graphics for the player setup controls, eject control, and eject control. energy. As shown in Figure 4C, the 435 user interface includes the 430 setup controls for selecting various soundtrack options. Functions, such as choosing a soundtrack or subtitle overlay, can be difficult to find when navigating through conventional CE device system submenus. Alternatively, these functions can be selected by switching a special key on a conventional remote control device (one of dozens of special use keys). A user can easily access these functions using remote controller 110 as the functions can be exposed much more directly by a context-specific user interface that includes configuration controls 430 as on-screen choices overlaying media content.
    Figure 4D illustrates a context-specific user interface 445 that is displayed by display device 120, in accordance with an embodiment of the present invention. When the operational context of the CE 115 device is to play digital video and audio content, an alternative to including transport controls (Play, Stop, Pause, Fast Forward, Rewind, Next, Previous) in the 445 context-specific user interface is include graphics for a timeline bar 440 on display device 120, with a "now" icon 455 representing the current display point. A user can directly drag (via cursor 420) icon now 455 along timeline bar 440 to shift to a different position along timeline bar 440. A gesture such as a double tap anywhere in the 455 context-specific user interface can activate the playback function and a light triple tap can activate the fast forward function.
    Chapter or index marks, such as index mark 450, can be displayed in timeline bar 440 to represent likely points in time to skip forward or to rewind. Gestures applied by a user to the touch-sensitive surface 105, such as dragging forward or backward along the timeline bar 440, can be modified near index marks so that the index marks exert “gravity” or "magnetism". Gravity or magnetism attracts the now 455 icon to grab the now 455 icon at an index mark when the now 455 icon is shifted near the index mark. Additionally, commercial content may be highlighted or otherwise graphically distinguished on the timeline bar 440 to allow the user to navigate past or to the commercial content.
    Figure 4E illustrates context-specific user interface 445 including a parallel timeline bar, in accordance with an embodiment of the present invention. Alternative scenes or angle variations can be displayed on the 445 user interface as timeline bars parallel to timeline bar 440. A parallel timeline bar 460 derives from timeline bar 440 and rejoins. it to represent a time region for which scenes from different angles of video and digital audio content are available. The parallel timeline bar 460 can include content such as alternate endings, or even director and actor commentary soundtracks.
    As an example, let's imagine a DVD with a director's commentary, 10 minutes of alternate angle shots of a key scene, and a different ending. A user may tap the touch-sensitive surface 105 to display the timeline bar 440 corresponding to the currently playing version of the movie. The parallel timeline bar 460 above the parallel timeline bar 440 can represent the program with the director's comment. Clicking the timeline bar 460 controls the CE 110 device to generate the director's comment version of the digital video and audio content for display on the display device 120. Two seconds before and up to ten seconds after the start of a session of the timeline bar 440 with an alternate scene angle, the parallel timeline bar 460 may automatically disappear, showing the parallel timeline bar 460 deriving from the primary timeline bar 440. Clicking the line bar Parallel Time Frame 460 can select an alternate scene angle and control the CE device 110 to generate the alternate scene angle of the digital video and audio content for display on the display device 120. Click back on the primary timeline bar 440 controls the CE device 110 to generate the primary scene angle of the digital video and audio content for display on the display device 120. Similarly, at any point along the primary timeline bar 440 where an alternate ending is possible, a parallel timeline bar may disappear from the context-specific user interface 445 so that the user can select the alternate ending for display.
    Figure 5 illustrates the remote controller 110 of Figure 1, in accordance with an embodiment of the present invention. Some solid keys, such as the 510 hardware controls, can be included on the remote controller 110 in addition to the touch-sensitive surface 105. For example, commonly used keys such as Volume Up/Down and Mute are included as the 510 hardware controls and are easy to use. of feeling in the dark. By using physical controls 510, a user avoids having a context-specific user interface displayed that can obscure the content displayed on the display device 120.
    Specific zones on the touch-sensitive surface 105 can serve as dedicated keys, shown as the virtual controls 520. The virtual controls 520 can be identified by texture printed on the touch-sensitive surface 105, printing (silkscreen, offset, etc.) on the touch-sensitive surface to touch 105, or selective backlighting. A user can stroke up or down along the right edge or other designated zone of the touch-sensitive surface 105 to manage volume, for example, upward strokes increase volume and downward strokes decrease volume. In one modality, a small wheel or roller on the side or top of the remote 110 is used to manage volume and control the timeline bar.
    Remote controller 110 may also be configured to emit sound to indicate an error, such as when a user attempts to manipulate a control that is inappropriate for the current operating context; for example, trying to select “Play” when a video is already playing. Sounds can also be used for aural feedback of click or drag gestures, or to indicate when the moving cursor is positioned to select a graphic for a control.
    An advantage of the revealed technique is that the context-specific user interface includes controls that are pertinent to the operational context of the CE 115 device. Using a pointing device such as the cursor that is controlled by user gestures provides an intuitive mechanism for controlling the CE 115 device. The 110 remote controller is very simple and can be operated easily in the dark or without additional lighting. Also, remote controller 110 is "always on" and does not need to be "waked up" or enabled by entering a password or other operation to "power up" the device.
    Another advantage of an indicator interface, such as that provided by a cursor having a position controlled by remote controller 110, is the ability to navigate a dense and rich set of options and alternatives, in a manner similar to that of a website. Let's imagine 100,000 movie titles available for playback on a streaming Internet movie player. The ability to shift the cursor in any direction when applying a gesture to the touch-sensitive surface 115 provides the user with an intuitive interface to search, sort, select categories, sort, and choose rich meta-content. Content developed for viewing on a personal computer and browsing using a pointing device can be viewed on the CE device 115 and navigated using the context-specific user interface and remote controller 110.
    While the foregoing is directed to embodiments of the present invention, other and additional embodiments of the invention can be envisioned without departing from the basic scope of the same. For example, aspects of the present invention can be implemented in hardware or software or in a combination of hardware and software. An embodiment of the invention may be implemented as a program product for use with a computer system. The program product program(s) define(s) functions of the modalities (including the methods described in this document) and may be contained on a variety of computer-readable storage media. Illustrative computer-readable storage media include, but are not limited to: (i) non-writable storage media (eg, read-only memory devices inside a computer such as CD-ROM disks readable by a CD drive -ROM, flash memory, ROM chips or any type of non-volatile solid-state semiconductor memory) in which information is permanently stored; and (ii) writable storage media (eg, floppy disks inside a floppy disk or hard disk drive or any type of solid-state semiconductor random access memory) on which alterable information is stored. Such computer readable storage media, when carrying computer readable instructions which pertain to the functions of the present invention, are embodiments of the present invention.
    Therefore, the scope of the present invention is determined by the following claims.
    权利要求:
    Claims (17)
    [0001]
    1. A computer-implemented method for controlling a consumer electronic device (115), the method comprising: receiving (300) a first touch-sensitive surface gesture from a remote controller (110) that is configured to control the consumer electronic device (115); determining (305) whether a video presentation being generated for display by the consumer electronic device (115) is in an idle state or in a playback state; when the video presentation is in an idle state: generating (310) a first user interface (435) for display, wherein the first user interface (435) includes cursor selectable graphics for configuration controls (430) to the consumer electronic device (115); generating (315) for displaying a cursor (420) superimposed on the first user interface (435) and having a position that is controllable by the remote controller (110); and executing a command associated with a cursor-selectable graphical element included in the first user interface (435) based on the cursor position (420), wherein the cursor-selectable graphical elements for configuration controls (430) are overlaid on the display of video; when the video presentation is in a playing state: generating (310) a second user interface (445) for display, wherein the second user interface (445) includes cursor selectable graphics for transport controls (440, 450, 455) for playing the video presentation; generating (315) for displaying a cursor (420) superimposed on the second user interface (445) and having a position that is controllable by the remote controller (110); and executing a command associated with a cursor-selectable graphical element included in the second user interface (445) based on the position of the cursor (420); the method characterized in that it further comprises: generating (310) a third user interface (445) for display, wherein the third user interface (445) includes cursor selectable graphics for alternative transport controls (460) for playing the video presentation, and wherein the alternate transport controls (460) are associated with the same playback duration as the transport controls (440, 450, 455); where the cursor-selectable graphics for transport controls (440, 450, 455) and the cursor-selectable graphics for alternate transport controls (460) are simultaneously overlaid on the video presentation.
    [0002]
    2. Method according to claim 1, characterized in that the remote controller (110) controls the playback of the video presentation by specifying the position of the cursor (420) at a time point along a line bar of time (440) included in the transport controls (440, 450, 455).
    [0003]
    3. Method according to claim 2, characterized in that the remote controller (110) controls the playback of the video presentation by specifying the position of the cursor (420) at a second time point along a second bar of timeline (460) included in alternate transport controls (460), where the second time point corresponds to the time point.
    [0004]
    4. The method of claim 1, further comprising the steps of: determining (325) that a downtime controller has expired; and interrupt (335) generating the cursor (420) on the first user interface (435) or on the second user interface (445) for display.
    [0005]
    5. Method according to claim 1, characterized in that the cursor-selectable graphical elements include navigation controls for digital content stored in the consumer electronic device (115) or through a network coupled to the consumer electronic device ( 115).
    [0006]
    6. Computer-readable non-transient media containing a set of instructions that, when executed, perform the method with the steps of: receiving (300) a first touch-sensitive surface gesture from a remote controller (110) that is configured to controlling the consumer electronic device (115); determining (305) whether a video presentation being generated for display by the consumer electronic device (115) is in an idle state or in a playback state; when the video presentation is in an idle state: generating (310) a first user interface (435) for display, wherein the first user interface (435) includes cursor selectable graphics for configuration controls (430) to the consumer electronic device (115); generating (315) for displaying a cursor (420) superimposed on the first user interface (435) and having a position that is controllable by the remote controller (110); and executing a command associated with a cursor-selectable graphical element included in the first user interface (435) based on the cursor position (420), wherein the cursor-selectable graphical elements for configuration controls (430) are overlaid on the display of video; or when the video presentation is in a playing state: generating (310) a second user interface (445) for display, wherein the second user interface (445) includes cursor selectable graphics for transport controls (440 , 450, 455) for playing the video presentation; generating (315) for displaying a cursor (420) superimposed on the second user interface (445) and having a position that is controllable by the remote controller (110), and executing a command associated with a cursor selectable graphic element included in the second interface user (445) based on cursor position (420); computer-readable non-transient media characterized in that the method further comprises the step of: generating (310) a third user interface for (445) display, wherein the third user interface (445) includes selectable graphical elements by cursor to alternate transport controls (460) for playback of the video presentation, and wherein the alternate transport controls (460) are associated with the same playback duration as the transport controls (440, 450, 455); where the cursor-selectable graphics for transport controls (440, 450, 455) and the cursor-selectable graphics for alternate transport controls (460) are simultaneously overlaid on the video presentation.
    [0007]
    7. Media according to claim 6, characterized in that the remote controller (110) controls the playback of the video presentation by specifying the cursor position (420) at a time point along a line bar of time (440) included in the transport controls (440, 450, 455).
    [0008]
    8. Media according to claim 7, characterized in that the remote controller (110) controls the playback of the video presentation by specifying the cursor position (420) at a second time point along a second bar of timeline (460) included in alternate transport controls (460), where the second time point corresponds to the time point.
    [0009]
    9. Media according to claim 6, characterized in that the method further comprises the steps of: determining (325) that a downtime controller has expired; and interrupt (335) generating the cursor (420) on the first user interface (435) or on the second user interface (445) for display.
    [0010]
    10. Media according to claim 6, characterized in that the cursor-selectable graphic elements include navigation controls for digital content stored in the consumer electronic device (115) or through a network coupled to the consumer electronic device ( 115).
    [0011]
    11. A system (100) for controlling a consumer electronic device, the system comprising: a remote controller (110) that is configured to control a consumer electronic device (115), wherein one or more signals are generated in response to a first touch-sensitive surface gesture that is applied to a touch-sensitive surface (105) of the remote controller (110); and a processor that receives one or more signals from the remote controller (110) and is configured to: receive (300) the first touch-sensitive surface gesture from the remote controller (110); determining (305) whether a video presentation being generated for display by the consumer electronic device (115) is in an idle state or in a playback state; when the video presentation is in an idle state: generating (310) a first user interface (435) for display, wherein the first user interface (435) includes cursor selectable graphics for configuration controls (430) to the consumer electronic device (115); generating (315) for displaying a cursor (420) superimposed on the first user interface (435) and having a position that is controllable by the remote controller (110); and executing a command associated with a cursor-selectable graphical element included in the first user interface (435) based on the cursor position (420), wherein the cursor-selectable graphical elements for configuration controls (430) are overlaid on the display of video; when the video presentation is in a playing state: generating (310) a second user interface (445) for display, wherein the second user interface (445) includes cursor selectable graphics for transport controls (440, 450, 455) for playing the video presentation; generating (315) for displaying a cursor (420) superimposed on the second user interface (445) and having a position that is controllable by the remote controller (110); and executing a command associated with a cursor-selectable graphical element included in the second user interface (445) based on the position of the cursor (420); the system (100) characterized in that the processor receiving one or more signals from the remote controller (110) is further configured to: generate (310) a third user interface (445) for display, wherein the third user interface user (445) includes cursor-selectable graphics for alternate transport controls (460) for playback of the video presentation, and where the alternate transport controls (460) are associated with the same playback duration as the transport controls (440, 450, 455); where the cursor-selectable graphics for transport controls (440, 450, 455) and the cursor-selectable graphics for alternate transport controls (460) are simultaneously overlaid on the video presentation.
    [0012]
    12. System (100) according to claim 11, characterized in that the cursor selectable graphics for transport controls (440, 450, 455) are superimposed on the video presentation when the video presentation is in the state of reproduction.
    [0013]
    13. System (100) according to claim 11, characterized in that when the video presentation is in an idle state, the first user interface (435) is generated for display to a display device (120 ), when the video presentation is in an idle state, the second user interface (445) is generated for display to the display device (120), and the display device (120) is integrated with the consumer electronic device (115).
    [0014]
    14. System (100) according to claim 11, characterized in that the remote controller (110) controls the playback of the video presentation by specifying the position of the cursor (420) at a point of time along a timeline bar (440) included in transport controls (440, 450, 455).
    [0015]
    15. System (100) according to claim 14, characterized in that the remote controller (110) controls the playback of the video presentation by specifying the position of the cursor (420) at a second time point along a second timeline bar (460) included in the alternate transport controls (460), where the second time point corresponds to the time point.
    [0016]
    16. System (100) according to claim 11, characterized in that the processor is additionally configured to: determine (325) that a controller has expired downtime; and interrupt (335) generating the cursor (420) at the first user interface (435) or at the second user interface (445) for display.
    [0017]
    17. System (100) according to claim 11, characterized in that the cursor-selectable graphic elements include navigation controls 15 for digital content stored in the consumer electronic device (115) or through a network coupled to the device consumer electronics (115).
    类似技术:
    公开号 | 公开日 | 专利标题
    BR112013013945B1|2021-08-17|COMPUTER AND SYSTEM IMPLEMENTED METHOD TO CONTROL A CONSUMER ELECTRONIC DEVICE, AND COMPUTER-READABLE NON TRANSITIONAL MEDIA
    JP2014500558A5|2014-10-09|
    US20210126960A1|2021-04-29|Directional Touch Remote
    WO2017088406A1|2017-06-01|Video playing method and device
    EP2182522B1|2017-05-17|Information processing
    KR102129978B1|2020-07-03|Mobile user interface for contextual browsing while playing digital content
    US20140317572A1|2014-10-23|Digital device and method of controlling therefor
    US9774817B2|2017-09-26|Transport controls for a media device
    WO2020007013A1|2020-01-09|Search page interaction method, device and terminal and storage medium
    US20080022231A1|2008-01-24|Systems and Methods for Downloading Interactive Content to Implement Remote Control Functionality in a Video Playback Device
    US20150163443A1|2015-06-11|Display apparatus, remote controller, display system, and display method
    US8749426B1|2014-06-10|User interface and pointing device for a consumer electronics device
    US20170068514A1|2017-03-09|Electronic device and method for controlling the same
    US10976895B2|2021-04-13|Electronic apparatus and controlling method thereof
    WO2016112791A1|2016-07-21|Method and device for displaying interface of application program on mobile terminal
    JP2008118618A|2008-05-22|System and method for downloading interactive content to implement remote control functionality in video playback device
    US20200142569A1|2020-05-07|Electronic apparatus and method of freezing screen
    同族专利:
    公开号 | 公开日
    JP2014500558A|2014-01-09|
    US20150169172A1|2015-06-18|
    MX2013006311A|2013-07-29|
    WO2012078665A1|2012-06-14|
    CA2819709C|2016-08-02|
    US20120139847A1|2012-06-07|
    EP2649501A1|2013-10-16|
    KR20130108636A|2013-10-04|
    JP5770856B2|2015-08-26|
    KR101525091B1|2015-06-02|
    EP2649501A4|2015-07-01|
    US9766772B2|2017-09-19|
    BR112013013945A2|2016-09-27|
    CA2819709A1|2012-06-14|
    US8963847B2|2015-02-24|
    引用文献:
    公开号 | 申请日 | 公开日 | 申请人 | 专利标题
    JPH05333839A|1992-06-03|1993-12-17|Sony Corp|Image display device|
    US5682326A|1992-08-03|1997-10-28|Radius Inc.|Desktop digital video processing system|
    KR0170326B1|1994-07-27|1999-03-30|김광호|Remote control method and apparatus|
    US5517257A|1995-03-28|1996-05-14|Microsoft Corporation|Video control user interface for interactive television systems and method for controlling display of a video movie|
    JPH09305305A|1996-03-15|1997-11-28|Matsushita Electric Ind Co Ltd|Image display device and its remote control method|
    JPH10112888A|1996-08-14|1998-04-28|Sony Corp|Remote controller|
    US6330592B1|1998-12-05|2001-12-11|Vignette Corporation|Method, memory, product, and code for displaying pre-customized content associated with visitor data|
    US6538665B2|1999-04-15|2003-03-25|Apple Computer, Inc.|User interface for presenting media information|
    EP1264294B1|2000-03-15|2013-12-18|Logitech Europe S.A.|State-based remote control system|
    US20010033243A1|2000-03-15|2001-10-25|Harris Glen Mclean|Online remote control configuration system|
    US6765557B1|2000-04-10|2004-07-20|Interlink Electronics, Inc.|Remote control having touch pad to screen mapping|
    JP4963141B2|2000-04-27|2012-06-27|ソニー株式会社|Information providing apparatus and method, and program storage medium|
    JP2004525675A|2001-01-24|2004-08-26|インターリンクエレクトロニクスインコーポレイテッド|Game and home entertainment device remote control|
    KR100811339B1|2001-10-11|2008-03-07|엘지전자 주식회사|Method and system for realizing remote controlling graphic user interface|
    JP4446728B2|2002-12-17|2010-04-07|株式会社リコー|Displaying information stored in multiple multimedia documents|
    US7109974B2|2002-03-05|2006-09-19|Matsushita Electric Industrial Co., Ltd.|Remote control system including an on-screen display |
    US7053965B1|2003-06-10|2006-05-30|Fan Nong-Qiang|Remote control for controlling a computer using a screen of a television|
    US7603689B2|2003-06-13|2009-10-13|Microsoft Corporation|Fast start-up for digital video streams|
    KR100533675B1|2003-07-24|2005-12-05|삼성전자주식회사|Apparatus and Method for remote-control using structured-data format|
    US7880813B2|2003-08-29|2011-02-01|Panasonic Corporation|Control device and control method with corresponding arrangement of image regions|
    JP4203741B2|2003-09-25|2009-01-07|日本電気株式会社|Data reproducing apparatus and data reproducing method|
    US20050188406A1|2004-02-23|2005-08-25|Gielow Christopher C.|System and method for managing applications and media content of a wireless communication device|
    US8479122B2|2004-07-30|2013-07-02|Apple Inc.|Gestures for touch sensitive input devices|
    JP2006094210A|2004-09-24|2006-04-06|Toshiba Corp|Broadcast receiving system|
    JP2006147084A|2004-11-22|2006-06-08|Funai Electric Co Ltd|Optical disk recording and reproducing apparatus|
    US20060150225A1|2005-01-05|2006-07-06|Microsoft Corporation|Methods and systems for retaining and displaying pause buffer indicia across channel changes|
    US7788592B2|2005-01-12|2010-08-31|Microsoft Corporation|Architecture and engine for time line based visualization of data|
    JP2007048383A|2005-08-10|2007-02-22|Matsushita Electric Ind Co Ltd|Information recording medium, its recording device, recording method, and recording program|
    US8837914B2|2005-11-30|2014-09-16|Samsung Electronics Co., Ltd.|Digital multimedia playback method and apparatus|
    US20080002021A1|2006-06-30|2008-01-03|Guo Katherine H|Method and apparatus for overlay-based enhanced TV service to 3G wireless handsets|
    US8564544B2|2006-09-06|2013-10-22|Apple Inc.|Touch screen device, method, and graphical user interface for customizing display of content category icons|
    US20080062137A1|2006-09-11|2008-03-13|Apple Computer, Inc.|Touch actuation controller for multi-state media presentation|
    US7673254B2|2006-09-14|2010-03-02|Intel Corporation|Apparatus, system and method for context and language specific data entry|
    KR101368713B1|2006-11-20|2014-03-04|삼성전자주식회사|Broadcast receiver and display method|
    US8170396B2|2007-04-16|2012-05-01|Adobe Systems Incorporated|Changing video playback rate|
    US9767681B2|2007-12-12|2017-09-19|Apple Inc.|Handheld electronic devices with remote control functionality and gesture recognition|
    JP4513894B2|2008-05-16|2010-07-28|ソニー株式会社|Image processing apparatus, image processing method, image reproduction apparatus, image reproduction method, and program|
    US20100241699A1|2009-03-20|2010-09-23|Muthukumarasamy Sivasubramanian|Device-Based Control System|
    KR101789619B1|2010-11-22|2017-10-25|엘지전자 주식회사|Method for controlling using voice and gesture in multimedia device and multimedia device thereof|US9239890B2|2011-05-31|2016-01-19|Fanhattan, Inc.|System and method for carousel context switching|
    US9778818B2|2011-05-31|2017-10-03|Fanhattan, Inc.|System and method for pyramidal navigation|
    CN202818524U|2011-10-11|2013-03-20|Lg电子株式会社|Multimedia device and remote controller|
    US9131327B2|2011-10-12|2015-09-08|Blackberry Limited|Methods and apparatus to control accessories|
    EP2595399A1|2011-11-16|2013-05-22|Thomson Licensing|Method of digital content version switching and corresponding device|
    TWI448961B|2011-12-16|2014-08-11|Wistron Neweb Corp|Electronic apparatus and control method thereof|
    US9146616B2|2012-01-10|2015-09-29|Fanhattan Inc.|Touch-enabled remote control|
    KR101661526B1|2012-04-08|2016-10-04|삼성전자주식회사|Flexible display apparatus and user interface providing method thereof|
    CN102905183A|2012-10-11|2013-01-30|中兴通讯股份有限公司|Method for implementing split watching of TV programs, set top box, and TV system|
    KR102052960B1|2012-11-23|2019-12-06|삼성전자주식회사|Input apparatus, display apparatus and control method thereof|
    US9774917B1|2012-12-10|2017-09-26|Apple Inc.|Channel bar user interface|
    US10200761B1|2012-12-13|2019-02-05|Apple Inc.|TV side bar user interface|
    US9532111B1|2012-12-18|2016-12-27|Apple Inc.|Devices and method for providing remote control hints on a display|
    US10521188B1|2012-12-31|2019-12-31|Apple Inc.|Multi-user TV user interface|
    KR102044826B1|2013-01-02|2019-11-14|삼성전자 주식회사|Method for providing function of mouse and terminal implementing the same|
    US9143715B2|2013-03-14|2015-09-22|Intel Corporation|Remote control with capacitive touchpad|
    US9858050B2|2013-07-02|2018-01-02|Youi Labs Inc.|System and method for streamlining user interface development|
    WO2015052961A1|2013-10-08|2015-04-16|株式会社ソニー・コンピュータエンタテインメント|Information processing device|
    JP5924554B2|2014-01-06|2016-05-25|コニカミノルタ株式会社|Object stop position control method, operation display device, and program|
    GB201408258D0|2014-05-09|2014-06-25|British Sky Broadcasting Ltd|Television display and remote control|
    TWI585673B|2014-06-24|2017-06-01|蘋果公司|Input device and user interface interactions|
    CN110262733A|2014-06-24|2019-09-20|苹果公司|Calculate the character recognition in equipment|
    US9588625B2|2014-08-15|2017-03-07|Google Inc.|Interactive textiles|
    KR101635614B1|2014-11-27|2016-07-01|이동섭|An interface configuration method of a smart device for controlling eletronic devices|
    KR20160097520A|2015-02-09|2016-08-18|삼성전자주식회사|Display apparatus and ui dispaying method thereof|
    KR102250091B1|2015-02-11|2021-05-10|삼성전자주식회사|A display apparatus and a display method|
    US9874952B2|2015-06-11|2018-01-23|Honda Motor Co., Ltd.|Vehicle user interfacemanagement|
    US9652125B2|2015-06-18|2017-05-16|Apple Inc.|Device, method, and graphical user interface for navigating media content|
    US9826187B2|2015-08-25|2017-11-21|Echostar Technologies L.L.C.|Combined absolute/relative touchpad navigation|
    US9781468B2|2015-08-25|2017-10-03|Echostar Technologies L.L.C.|Dynamic scaling of touchpad/UI grid size relationship within a user interface|
    US9990113B2|2015-09-08|2018-06-05|Apple Inc.|Devices, methods, and graphical user interfaces for moving a current focus using a touch-sensitive remote control|
    US9928029B2|2015-09-08|2018-03-27|Apple Inc.|Device, method, and graphical user interface for providing audiovisual feedback|
    GB2552274A|2015-11-09|2018-01-17|Sky Cp Ltd|Television user interface|
    KR20170055165A|2015-11-11|2017-05-19|삼성전자주식회사|Electronic apparatus and method for controlling of an electronic apparatus|
    CN105872737B|2016-04-18|2019-04-02|高创电子有限公司|The control method and medium source equipment of media play, apparatus for media playing and system|
    US10747423B2|2016-12-31|2020-08-18|Spotify Ab|User interface for media content playback|
    US10489106B2|2016-12-31|2019-11-26|Spotify Ab|Media content playback during travel|
    US10585637B2|2017-03-27|2020-03-10|LenovoCo., Ltd.|Information processing method and electronic device|
    CN107085508B|2017-03-27|2020-03-24|联想有限公司|Information processing method and electronic equipment|
    CN110958473A|2018-09-26|2020-04-03|深圳Tcl数字技术有限公司|Remote control method, television and storage medium in low-brightness environment|
    US11057682B2|2019-03-24|2021-07-06|Apple Inc.|User interfaces including selectable representations of content items|
    法律状态:
    2018-12-18| B06F| Objections, documents and/or translations needed after an examination request according [chapter 6.6 patent gazette]|
    2019-10-01| B06U| Preliminary requirement: requests with searches performed by other patent offices: procedure suspended [chapter 6.21 patent gazette]|
    2020-11-03| B07A| Application suspended after technical examination (opinion) [chapter 7.1 patent gazette]|
    2021-03-02| B06A| Patent application procedure suspended [chapter 6.1 patent gazette]|
    2021-06-29| B09A| Decision: intention to grant [chapter 9.1 patent gazette]|
    2021-08-17| B16A| Patent or certificate of addition of invention granted [chapter 16.1 patent gazette]|Free format text: PRAZO DE VALIDADE: 20 (VINTE) ANOS CONTADOS A PARTIR DE 06/12/2011, OBSERVADAS AS CONDICOES LEGAIS. |
    优先权:
    申请号 | 申请日 | 专利标题
    US12/961,387|2010-12-06|
    US12/961,387|US8963847B2|2010-12-06|2010-12-06|User interface for a remote control device|
    PCT/US2011/063583|WO2012078665A1|2010-12-06|2011-12-06|User interface for a remote control device|
    [返回顶部]